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I. 


Introduction 


This  Is  the  final  report  of  the  CCS/CMC  Mathematics  Clinic. 
Oar  project  was  for  the  ©'ound  Data  Systems  section  of  the 
Intelligence  Analysis  Ci*oup  at  the  Jet  Propulsion  Laboratory. 
Our  project  concerned  the  gathering  of  intelligence  information 
through  radio  direction  finding  and  fixing.  Vie  focused  on  the 
way  radio  sensors  may  be  used  to  locate  radio  emitters  such  as 
radio  transmitters  or  radar  sets,  and  on  errors  in  the  readings 
returned  by  such  sensors.  The  goal  was  to  use  this  information, 
taking  into  account  various  errors,  so  that  a  region  can  be 
mapped  around  an  estimate  of  the  emitter  location  such  that  the 
true  location  of  the  emitter  lies  in  this  region  with  a  specified 
probability. 

We  examined  two  models  of  a  simple  intelligence  gathering 
scenario,  both  of  which  were  restricted  to  the  two-sensor  case. 
The  first  was  based  on  the  classical  assunptions  of  df  fixing 
originally  proposed  by  R.G.  Stansfield.  The  second  was  a  model 
constructed  by  the  Clinic,  which  was  created  by  relaxing  one  of 
Stansfield ’s  simplifying  assunptions.  Our  analysis  of  these 
models  revealed  that  this  particular  assumption  of  Stansfield 's 
Introduces  an  additional  error  which  is  eliminated  in  the  model 
constructed  by  the  Clinic.  The  goal  of  this  analysis  was  to 
critique  the  methods  currently  used  to  find  confidence  regions 
about  location  estimates. 

In  this  report,  we  first  discuss  Stansfield 's  model  as 
applied  to  the  two-sensor  case  and  its  implications  for  the 
construction  of  confidence  regions.  Second,  we  describe  our 
modification  of  the  classical  model,  and  certain  subsequent 
analytical  conplexities.  Third,  we  present  the  methods  that  we 
enployed  to  mitigate  the  effects  of  these  cooplexitles.  Fourth, 
we  compare  the  results  of  our  model  with  those  of  the  Stansfield 
model.  Vie  then  examine  other  types  of  errors  originating  from 
the  radio  sensors  and  their  placement,  and  show  in  particular 
that  a  two-dimensional  error  in  the  location  of  a  sensor  is 
equivalent  to  a  one-dimensional  angular  error  —  a  fecial  case 
of  our  general  model.  In  addition  we  will  discuss  several 
related  topics.  Including  a  one-sensor  acdel,  systematic  error, 
and  the  use  of  a  digitizer  or  other  eexuputer  analysis  aids. 
Finally,  we  discuss  areas  for  future  research  and  state  our  final 
conclusions. 
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II.  Stansfield'3  Model 


The  classical  df  fixing  model  was  studied  tv  R>G.  Stansfield 
during  World  War  II.  Here  we  use  a  simple  case  of  the  general 
model  with  two  radio  sensors  and  a  single  emitter.  In  Figure  1 
the  sensors  are  denoted  by  S1  and  S2,  and  the  emitter  is  labeled 
E.  Each  sensor  detects  the  radio  signals  broadcast  by  the 
emitter  and  returns  an  estimate  of  the  line  of  bearing  from  the 
sensor  to  the  emitter.  The  angles  the  true  lines  of  bearing  make 
with  the  baseline  are  denoted  by  Mu(Alpha)  and  Hi(Beta) 
respectively.  However,  it  is  improbable  that  the  sensors  would 
ever  return  exactly  these  lines  of  bearing,  due  to  a  variety  of 
factors  such  as  operator  error,  equipment  error,  terrain  effects 
and  atmospheric  conditions.  We  will  group  these  effects  under 
the  heading  "measurement  error." 

The  question  arises  as  to  how  this  measurement  error  is 
quantified.  Clearly,  these  errors  will  be  in  degrees  since  the 
readings  returned  by  the  sensors  are  themselves  in  degrees. 
However,  in  order  to  sinplify  the  analysis,  Stansfield  made  a 
number  of  important  assumptions,  which  are  enumerated  below. 
Assumption  (3)  is  particularly  relevant  at  this  point. 

(1 )  The  earth  is  flat  near  the  true  positiwi  of  the 
transmitter. 

(2)  The  bearing  lines  are  straight. 

(3)  An  error  of  observation  di^laces  the  bearing  line 
parallel  to  itself. 

(4)  Ehrors  in  separate  bearings  contributing  to  a  fix  are 
independent. 

(b)  The  errors  are  normally  distributed  about  a  mean  of 
zero,  and  the  variances  are  known. 

The  third  assunption  is  significant,  and  is  detailed  in 
Figure  2.  Suppose  that  sensor  2  has  returned  the  true  line  of 
bearing  i^om  itself  to  the  emitter,  while  sensor  1  is  in  error. 
That  is,  sensor  1  returns  the  angle  Alpha,  and  thus  the  line  of 
bearing  in  Figure  2  labeled  L2.  Examination  of  these  readings 
would  place  the  estimate  of  the  emitter's  location  at  E'.  How, 
this  is  where  Assunpticn  3  makes  itself  felt.  Rather  than 
measuring  the  error  in  sensor  1  's  reading  bjr  the  difference 
Mu  (Alpha)  >  Alpha,  Stansfield  draws  a  new  line  Urough  point  E' 
parallel  to  the  true  line  of  bearing  from  senscH*  1  to  the 
emitter.  He  measures  the  error,  D1,  in  terms  of  the  distance 
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between  the  true  line  of  bearing  and  Its  parallel  displaoement  at 
E'.  Put  another  way,  the  error  D1  in  sensor  1 ’s  reading  is  the 
perpendicular  distance  from  E’  to  the  true  line  of  bearing. 
Errors  in  the  reading  from  sensor  2  are  dealt  with  similarly. 

The  essence  of  Stansfield's  simplifying  assumption  is  this 
—  the  error  in  a  sensor  reading  may  be  measured  by  this  parallel 
displaoement  (or  perpendicular  distance)  without  regard  for  the 
corresponding  angular  error.  Further,  he  makes  the  following 
assuoption  about  the  nature  of  the  error;  the  distance  between 
the  true  line  of  bearing  and  the  parallel  displaced  line  follows 
the  normal  probability  law  with  a  mean  of  zero  and  some  known 
standard  deviation.  Since  this  assuqption  is  assumed  to  hold  for 
both  sensors,  the  estimate  of  the  location  will  follow  the 
bivariate  normal  probability  law.  The  density  function  for  this 
distribution  la  shown  in  Equation  1. 


(1) 


■f 


<t,S 


This  is  a  desirable  result  as  the  bivariate  normal  is  a  well* 
understood  probability  law  with  many  useful  properties.  Thus, 
the  above  simplifying  assumption  has  ramifications  for  the 
estimate  of  the  emitter  location.  Which  includes  both  the  point 
estimate  and  the  confidence  region. 

We  must  digress  momentarily  to  define  these  terms.  The 
point  estimate  is  slnply  the  most  likely  position  of  the  emitter 
given  the  sensor  readings.  Due  to  the  error  in  the  sensor 
readings,  it  is  unlikely  that  the  point  estimate  will  exactly 
equal  the  true  location  of  the  emitter.  This  is  why  confidence 
regions  are  constructed.  The  region  estimate,  or  confidence 
region,  measures  how  far  the  point  estimate  is  likely  to  be  from 
the  true  position  of  the  emitter.  In  Figure  3  there  is  a  95)( 
confidence  ellipse  of  the  type  that  one  would  oaloulate  using  the 
Stansfleld  model.  As  before,  E  represents  the  emitter,  and  E' 
the  point  estimate  of  the  emitter's  location.  The  meaning  of 
this  ellipse  is  that  if  one  estimates  the  location  of  the  emitter 
100  times,  and  constructs  a  confidence  ellipse  each  time,  one 
would  expect  about  95  of  the  oonfidenoe  ellipses  constructed  to 
contain  point  E. 

While  the  confidence  region  in  this  example  is  an  ellipse, 
oonfidenoe  regions  oan  take  many  different  shapes.  In  Figure  3, 
both  the  ellipse  and  the  square  are  951  oonfidenoe  regions. 
Since  the  ellipse  captures  the  same  probability  in  a  smaller 
area,  it  is  a  better  estimate  of  the  error  in  our  point  estimate. 
In  fact,  this  is  the  definition  of  an  cg)timal  oonfidenoe  region: 
it  is  that  region  which  captures  the  desired  level  of  confidence 
in  the  smallest  area. 

Because  of  the  assumption  of  parallel  error  displacement, 


the  optimal  confidence  region  in  Stansfield's  model  is  an  ellipse 
having  the  formula  shown  in  Equation  2. 


(2) 


This  is  the  ordinary  confidence  region  associated  with  the 
bivariate  noritBl  distribution. 


Modifications;  The  Clinic’s  Model 


As  is  the  case  with  any  .eoretioal  rasearch,  it  is 
interesting  to  drop  assui!(>tiuns  and  determine  v^ether  the 
conclusions  are  significantly  altered.  Zn  studying  this  location 
problem,  the  Clinic  retained  the  assumptions  enumerated  above 
with  the  exception  of  Assumption,  (3)  —  the  parallel  error 
displacement  assumption.  In  its  place  we  use  the  more  natural 
assumption  of  angular  error  displaciemnt.  That  is,  we  measure  the 
error  in  a  sensor  reading  by  the  number  of  degrees  that  it 
deviates  from  the  true  line  of  bearing  —  the  difference 
Mu (Alpha)  -  Alpha.  Further,  we  assume  that  this  error  is 
normally  distributed  with  a  mean  of  zero  and  some  known  standard 
deviation.  Figure  4  shows  an  example  of  this  model.  As  in 
Figure  2,  the  true  lines  of  bearing  have  angles  Mu( Alpha)  and 
Mu(Beta)  with  the  baseline.  Sensors  i  and  2  return  the  angles 
Alpha  and  Beta  respectively,  yielding  the  estimated  emitter 
location  E* .  The  measurement  errors  in  these  readings  are 
Mu( Alpha)  -  Alpha  and  Mu(Beta)  >  Beta. 

Because  we  have  assumed  that  the  error  is  angular  and  not  a 
parallel  displacement  distance,  it  can  easily  be  shown  that  the 
distribution  of  the  emitter  location  estimate  about  the  true 
location  of  the  emitter  is  no  longer  the  bivariate  normal.  The 
nature  of  the  distribution  is  shown  by  the  following  analysis. 

Since  we  have  assumed  that  these  errors  are  normally 
distributed  about  a  mean  of  zero,  we  know  that  of  the 
readings  will  fall  within  2  standard  deviations  of  the  true 
line  of  bearing.  In  all  of  our  examples  we  have  arbitrarily 
chosen  a  standard  deviation  of  1  degree.  Thus,  if  Mu(Alpha)  «  60 
degrees  and  Mu  (Beta)  s  iio  degrees,  tTien  we  would  expect  959  of 
the  readings  for  sensors  1  and  2  to  fall  between  78  and  62 
degrees,  and  108  and  112  degrees  respectively.  Similarly,  999  of 
the  readings  should  fall  within  3  standard  deviations  ~  between 
77  and  83  for  sensor  1,  and  107  and  113  for  aenaor  2.  The 
bearing  lines  associated  with  these  extreme  values  give  us  the 
large  quadrilateral  in  Figure  5.  Further,  we  know  that  this 
quadrilateral  contains  about  989  (.99  x  .99)  of  the  emitter 


estimates.  To  obtain  a  rough  estimate  for  the  probability 
density  we  constructed  lines  of  bearing  oorreq>ondlng  to  errors 
of  ♦  0.5,  +1.0,  +1.5,  +2.0,  +2.5,  and  +  3.0.  These  rays 
divide  the  large  quaurilateral  into'"25  small  quadrilaterals,  as 
shown  in  /igure  5. 

As  the  next  step,  we  found  the  probability  of  a  location 
estimate  falling  into  each  of  these  small  quadrilaterals. 
Because  of  synmetry  in  the  angular  error  distribution  (the 
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normal),  corresponding  quadrilaterals  will  have  equal 
probabilities.  For  instance,  the  uppermost  and  bottoimost 
quadrilaterals  in  Figure  5,  both  labeled  Y,  have  the  same 
probability.  It  is  clear,  however,  that  their  areas  are  very 
different.  We  termed  this  array  of  quadrilaterals  with  assigned 
probabilities  a  probability  grid. 

These  quadrilaterals  marked  Y  have  the  same  probability, 
0.003672,  but  their  areas  are  3^10.3  and  1587.7  respectively. 
Thus,  the  average  probability  density  in  these  regions  are 
0.00000108  and  0.00000232  —  which  differ  by  a  factor  of  2. 
Clearly  the  distribution  of  the  location  estimates  about  the  true 
location  is  skewed. 

This  shows  that  even  »^en  the  angular  error  for  each  line  of 
bearing  is  normally  distributed.,  the  points  of  intersection  of 
these  lines  of  bearing  do  not  have  a  bivariate  normal 
distribution.  Finer  grids  of  more  than  3600  small  quadrilaterals 
were  produced  both  graphically  and  analytically  by  computer. 
Both  methods  showed  evidence  that  the  points  were  not  distributed 
according  to  the  bivariate  normal  probability  law.  Because  the 
density  function  is  not  the  bivariate  normal,  there  is  no  reason 
to  believe  that  the  best  confidence  regions  are  elliptloally 
shaped. 


IV. 


Methods  to  Determine  F\ingtlonal  Form 


The  Clinic  used  the  probability  gi'id  derived  above  to 
explore  the  shape  of  the  density  function  in  a  number  of  ways, 
including  strips  of  probability  and  bands  of  ecui-density. 

As  was  stated  in  the  previous  section,  If  the  bivariate 
noroBl  function  were  used,  then  tiie  large  quadrilateral  would  be 
symoietrically  shaped  and  any  two  corresponding  quadrilaterals, 

(  such  as  those  in  Figure  5,  would  have  the  same  average 

I  probability  density.  If  bands  of  equi^>robablllty  were  graphed 

so  that  only  those  points  satisfying  a  glveii  inequality  were 
plotted,  one  would  expect  to  see  the  points  evenly  distributed 

(above  and  below  the  true  emitter  locatio't.  When  angular 
displacement  is  used,  it  is  clear  that  the  points  are  not  equally 
distributed  about  the  true  emitter  location.  If  fact,  if  regions 

{of  relatively  high  density  are  graphed,  then  the  majority  of  the 
plotted  points  will  lie  below  the  intersection  of  the  true  lines 
of  bearing.  Conversely,  if  low  density  regions  are  graphed,  then 
j  the  majority  of  the  points  will  lie  above  the  Intersection  of  the 

true  lines  of  bearing.  This  tells  us  that  regions  above  the  true 
location  have  lower  density  than  those  below. 

(Examining  UjC  "strips"  shown  in  Figure  6  yielded  similar 
results.  These  strips  were  constructed  sc  as  to  divide  the 
distribution  into  a  number  of  bands  of  equal  width  both  above  and 

I  below  the  true  location  of  the  emitter.  The  probability  of  any 

reading  falling  into  each  of  these  strips  was  calculated  using  a 
probability  grid.  If  the  distribution  were  the  bivariate  normal, 

fwe  would  expect  corresponding  strips  above  and  below  the  true 

emitter  location  to  have  about  the  same  probability.  Table  1 , 
however,  shows  a  case  in  which  the  skewness  of  the  distribution 
is  quite  clear. 

Having  tried  other  techniques  to  determine  the  shape  of  the 
probability  function  and  its  corresponding  confidence  regions 
without  much  success,  the  Clinic  decided  to  Investigate 
transforming  the  probability  ftintlcn  from  the  angular  to  the 
rectangular  coordinate  system.  This  Is  equivalent  to 
transforming  the  bivariate  normal  (Equation  #1).  The 
transformation  for  the  X  and  Y  coordinates  are  given  below: 


(3)  X  «  - P  f - 

tan  0  -  tan  b 


Y  •  P  tan  B  tan  B 
tan  B  -  tan  b 
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or  inversely, 


To  obtain  the  joint  density  of  X  and  Y  we  use  the  following 
transformation  fornula; 

Mhcr*  IJI  is  ths  dstsrminsnt  of  ths  foil  owl nQ  matrix  i 


(6) 


aa 

ax 

aY 

Lax 

dYj 

-Y 


X^-rY^ 


-Y 


(X-D>^-*-Y^ 


X-D 


X^+Y^ 

X-D 


(X-D>^+Y^ 


Solving,  this  gives  us 


<7) 


Y  D 


(x^+Y*)  [(x-d)^4.Y^] 


Using  these  transformations  and  the  bivariate  normal  it  is 
possible  to  rewrite  the  equation  in  terms  of  X  and  Y.  The  result 
is  presented  below: 


(6) 


f  (X.Y)  <■  1  I  I  ^  P 

<xW)[(x-d)W] 


1 

Y  > 

-lY  .-10 
tan  =•  -tan  rr- 

*  *0 

2 

*  -1  Y  .  -1  ^0 

X-D  Xq-D 

“2 

i 

•a 

Mhmrs  <Xq,Yq)  rorrmsponds  to 


However,  this  density  function  is  not  easy  to  analyze  either 
analytically  or  numerically.  Therefore,  the  Clinic  transformed 
the  optimal  confidence  region  from  the  angular  coordinate  system, 
using  the  same  relation^ips  for  X  and  X.  This  yielded  the 
following  inequality: 


<9) 


_ _ _  *0 


^--1  e 

X-D  X--D 
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<  X 


Wnen  the  boundary  points  of  this  Inequality  are  graphed,  the 
region  is  nearly,  but  not  quite  elliptical. 

Since  it  was  not  possible  to  tell  visually  how  significantly 
these  regions  differed  from  ellipses,  the  Clinic  performed  a 
least  squares  analysis  on  the  regions.  First,  we  generated  50 
boundary  points  from  the  original  angular  oonfidenoe  Inequality. 
These  points  were  then  transformed  into  the  XY  coordinate  system 
using  the  transformation  formulas.  These  are  the  data  that  were 
used  in  the  regression. 

The  general  form  of  a  quadratic  equation  in  the  XY  system  is 
given  below: 


(10) 


+  B'XV  C»Y*  ♦  D'X  -f  E^Y  4  F- 


Manipulating  this  equation  yields  a  form  which  can  be  estimated 
by  the  techniques  of  ordinary  least  squares. 


(11) 


where  B  ■  B' /A' , 
end  F  ■  F' /A' . 


*  -BXY  -  CY^  -  DX  -  EY  -  F 


C  »  C'/A' 


DVA',  E  «  E'/A' 


Vihile  this  estloated  ellipse  is  only  an  approximation  to  the 
transformed  region,  it  is  quite  close.  For  example,  wSven  we 
estimated  a  9511  oonfidenoe  ellipse  in  the  .angular  coordinate 
system  for  the  Mu(Alpha)«60  degree  /  Mu(Beta)Bl10  degree  case, 
the  estimated  ellipse  using  regression  contained  95.011 i 
of  the  probability.  Suoh  a  small  deviation  from  the  desired  95^ 
can  be  accounted  for  by  numerioal  errors  inherent  ,ln  the  method 
snployed,  as  well  as  the  grid  size  used.  Due  to  the  closeness  of 


'■m 


m 


m 
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the  approximation,  and  the  difficulties  in  analyzing  the 
transformed  regions,  it  is  these  ellipses,  determined  by  linear 
regression  which  we  will  use  to  contrast  with  the  Stansfield 
ellipses. 


V.  Comparison  of  the  Confldenoe  Region  Methods 


We  have  now  examined  two  distinct  methods  of  oonstruotlng 
confidence  regions:  Stansfleld's  and  the  Clinic's.  In  this 
section  we  shall  compare  the  results  obtained  from  both  methods 
when  they  are  applied  to  the  Clinic's  version  of  the  two-sensor 
model.  Ihe  results  show  that  while  the  Clinic's  method  is  not 
necessarily  the  optimal  method  of  oonstruotlng  confidence  regions 
given  out  model,  it  is  a  better  method  than  Stansfield's.  That 
is,  the  Clinic's  confldenoe  regions  capture  a  given  amount  of 
probability  in  a  smaller  area  than  do  Stansfield's. 

The  first  method  is  that  formulated  by  Stansfield,  based  on 
his  parallel  displacement  assumption.  Sinoe  this  assunptlon 
allows  the  bivariate  normal  distribution  to  be  used,  the  optimal 
confidence  region  is  the  ordinary  ellipse  based  on  this 
distribution.  However,  if  the  parallel  displaoement  assumption 
is  dropped,  and  our  model  used  in  its  place,  the  Stansfield 
confidence  ellipse  is  no  longer  optimal.  Instead,  we  propose  the 
"transformed"  region  which  was  derived  in  the  previous  section  by 
transforming  the  optimal  ellipse  in  angular  coordinates  into  a 
region  in  rectangular  coordinates. 

As  we  have  discussed,  this  transformed  region  is  almost,  but 
not  quite,  elllptioal.  In  the  numerical  examples  presented  here 
we  have  used  our  least-squares  approximation  to  the  transformed 
region. 

At  this  point  we  must  digress  momentarily  to  ocnslder  the 
relationship  between  confidence  regions  and  probability  regions, 
which  are  sometimes  known  as  tolerance  regions.  An  example  of  a 
probability  region  is  one  of  the  quadrilaterals  In  our 
probability  grid.  Based  on  a  certain  probability  distribution, 
it  contains  a  certain  aa»unt  of  probability.  A  951  probability 
region  is  simply  a  region  which  oontains  95}  of  the 
distribution's  probability.  An  optimal  probability  region  we 
define  as  that  region  which  oontains  the  desired  probability  with 
the  smallest  area.  By  contrast,  the  optimal  95}  ocnfldenoe 
region  is  that  region  with  the  smallest  area  which  will  catch  the 
true  location  of  the  emitter  95  times  out  of  one  hundred. 

The  relationship  between  these  is  that  the  optimal  my  of 
constructing  a  probability  region  about  the  true  location  of  the 
emitter  is  also  the  optimal  way  of  constructing  a  confidence 
region  about  an  estimate  of  the  emitter's  location.  This  assumes 
that  the  probability  region  is  based  on  the  saspllng 
distribution,  but  this  is  Irrelevant  sinoe  the  sampling  and  the 
base  distributions  are  the  same  when  only  one  observation  is 
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taken  irrelevant.  The  result  is  that  Instead  of  constructing 
confidence  regions  we  may  construct  probability  regions  using  the 
same  methods,  and  arrive  at  valid  conclusions.  All  of  the 
analysis  in  this  section  was  done  using  probability  regions. 

In  particular  we  shall  focus  on  the  case  where  the  true 
lines  of  bearing  from  Sensors  1  and  2  are  80  degrees  and  110 
degrees  respectively.  Further,  the  sensors  are  1000  meters 
apart,  and  the  error  for  both  sensors  has  a  standard  deviation  of 
1  degree. 

Figure  7  contains  a  graph  of  the  501,  75%  and  95K 
probability  ellipses  calculated  using  the  classical  method,  and 
Table  2  lists  their  area  and  the  probability  contained  in  them. 
Note  that  they  are  concentric  and  oentered  at  the  true  emitter 
location.  Notice  further  that  they  do  not  contain  the  oorreot 
amount  of  probability.  In  fact,  they  tend  to  contain  about  25% 
less  probability  than  they  ought  to.  This  is  because 
Stansfield’s  ellipses  are  inappropriate  when  the  angular  error  is 
normally  distributed. 

The  graphs  of  the  501^,  75%  and  95%  regions  oaloulated  using 
the  Clinic's  method  are  shown  in  figure  6,  and  thei*'  areas  and 
probabilities  are  listed  in  Table  3>  Due  to  the  skf  ass  of  the 
density  function,  these  regions  are  not  oentered  >  >  the  true 
emitter  location.  Rather,  the  higher  the  desired  level  of 
confidence  the  further  the  region  is  positioned  from  the 
baseline.  These  regions,  which  are  only  approximations,  contain 
close  to  the  correct  probability.  In  fact,  the  dlfferenoes  are 
small  enough  to  be  indistinguishable  from  numarloal  errors 
Inherent  In  our  methods  of  analysis.  The  use  of  a  probability 
grid,  for  example,  guarantees  that  our  program  will  return 
values  good  only  to  a  few  decimal  places. 

Also  included  in  Tables  2  and  3  are  figures  for  the  70 
degree/170  degree  and  >15  degret/135  degree  oases.  The  related 
ellipses  are  graphed  in  Figures  9,  10,  11,  and  12.  Please  note 
that  the  scale  of  the  drawing  varies  from  figure  to  figure,  so 
direct  oompariaons  of  size  are  difficult.  The  "area"  values  in 
Tables  2  and  3  should  aid  oomparison.  These  results  strongly 
indicate  that  using  the  Stansfleld  model  brings  unnecessary  error 
into  the  process  of  construct ion  confidence  regions. 


V.  Sensor  Location  Error 


Thus  far,  we  have  discussed  the  angular  measurement  error 
that  can  occur  from  a  given  sensor  reading.  Htwever,  other  types 
of  error  are  also  encountered,  such  as  sensor  location  error. 

Sensor  location  error  occurs  when  the  acti.al  location  of  the 
sensor  differs  from  the  reported  location  of  the  sensor.  Fcr 
exanple,  suppose  it  is  believed  that  the  sensor  is  located  at 
position  SI  i.n  Figure  13  tAien,  in  fact,  it  is  at  point  A.  The 
effect  is  that  the  reported  angle,  and  consiKjuently  line  of 
bearing,  will  be  applied  to  the  point  S1  instead  of  A.  The 
result  is  that  the  estimated  location  is  E*  Instead  of  E.  Thus, 
the  estimate  of  the  emitter  location  has  shifted  from  E  to  E’ 
because  of  the  location  error. 

To  analyze  the  effect  of  this  error,  th£  Clinic  began  by 
assuming  that  the  distribution  of  the  sensor  location  error 
follows  the  bivariate  rwrmal  probability  law.  Then,  we 
constructed  a  circle  with  a  radius  of  3.5  signs  about  the  sensor. 
Due  to  the  characteristics  of  the  ncraal  probability 
distribution,  we  know  that  there  is  a  99%  probability  that  the 
sensor  lies  within  the  circle.  However,  it  is  not  necessary  to 
use  a  two  dimensional  region  such  as  a  circle  to  have  a  99S 
probability.  Note  that  any  point  on  or  wlthir.  the  circle  has  a 
corresponding  counterpart  on  the  baseline.  Hence,  if  the  sensor 
is  located  anywhere  on  the  leftmost  dotted  lire,  it  will  return 
the  same  reading  for  the  line  of  bearing.  T.nus,  we  need  to 
include  only  the  point  A*  in  the  analysis.  Similarily,  this  is 
true  for  any  sensor  position.  As  a  result,  ¥e  are  able  to 
restrict  the  analysis  to  the  points  that  lie  on  the  baseline. 

For  a  given  point  on  the  baseline,  a  line  can  be  drawn  to 
the  true  emitter  location.  The  angle  that  is  formed  with  the 
baseline  is  the  repeated  angle.  It  is  this  angle  that  is  then 
applied  to  the  point  S1 .  which  is  where  the  sensor  is  believed  to 
be.  The  resulting  estimate  of  the  emitter  is  E'  (See  Figure  14). 

It  becomes  of  interest  to  examine  the  distribution  of  these 
angles  for  a  given  sensor  location.  Thus,  a  portion  of  the 
baseline  (at  least  three  sigma)  was  subdivided  into  fifteen 
equally  spaced  intervals.  A  line  segment  was  constructed  from 
the  midpoint  of  the  interval  to  the  true  emitter  location.  From 
this,  the  angle  that  is  formed  by  this  line  segment  and  the 
baseline  can  be  calculated.  Each  of  these  intervals  has  a 
probability  associated  with  it,  and  this  probability  corresponds 
to  the  angle  as  well.  This  distribution  of  angles  is  plotted  in 
Figure  15  along  with  the  normal  distribution  having  the  same  mean 


13 


and  sigma  values.  As  this  diagram  snows,  the  distribution  of  the 
angles  is  very  close  to  normal.  Thus,  we  have  demonstrated  that 
the  sensor  location  error  problem  is  equivalent  to  the  angular 
measurement  error  discussed  earlier,  and  the  distribution  of  the 
angles  about  the  mean  la  approximately  normal. 


VI.  Other  Topics 


i 

1 
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During  the  course  of  the  year  the  Clinic  also  examined  a 
nurcber  of  other  topics,  including  a  one-radar  scenario, 
systeoatlc  error  due  to  equipoent  bias,  and  the  potential  use  of 
a  digitizer  or  similar  hardware  by  an  intelligence  analyst. 

The  one-radar  scenario  is  based  ai  the  Clinic's  two-sensor 
model,  and  follows  all  of  the  same  assunptions.  The  only 
difference  is  the  nature  of  the  sensor.  In  the  two-sensor  case, 
each  sensor  returns  a  single  line  of  bearing.  Thus,  two  sensors 
are  required  to  locate  an  emitter.  In  the  one-radar  scenario, 
shown  in  Figure  16,  we  use  a  full  radar  set  in  place  of  a  sensor. 
Since  the  radar  is  not  merely  a  passive  receiver  of  radio 
signals,  but  also  a  transmitter,  it  is  able  to  supplement  the 
line  of  bearing  with  a  distance  reading  along  that  line  of 
bearing. 

In  Figure  16,  the  emitter  is  denoted  by  E  (actually,  it 
could  be  any  object  large  enou^  to  register  on  a  radar),  and  the 
radar  is  denoted  by  S.  The  line  SE  is  the  true  line  cf  bearing 
from  the  radar  to  the  emitter,  and  the  length  of  line  segment  SE 
is  the  true  distance,  r.  The  angle  the  true  line  of  bearing 
nakes  with  the  baseline  is  a.  In  this  figure  a  reading  has  been 
taken,  returning  the  values  (r',a'),  and  the  resulting  estimate 
of  the  emitter's  location  is  E'. 

If  Stansfield's  assunptions  are  applied  to  this  model,  only 
one  is  modified  —  that  of  parallel  error  di^lacement.  Instead, 
error  is  measured  in  the  natural  wits:  degrees  for  the  angle 
reading  and  meters  for  the  distance  reading.  Further,  we  assume 
that  the  error  in  both  of  these  readings  is  normally  distributed 
around  zero  error  with  some  known  standard  deviation. 

The  analysis  done  on  this  model  was  based  on  a  probability 
grid  conpletely  analogous  to  that  used  in  the  two-sensor  case. 
Such  a  grid  is  shown  in  Figure  17.  As  before  we  calculated  the 
probability  of  a  reading  falling  In  each  of  the  small  regions, 
and  used  this  to  ^proximate  the  density  function.  Vhile  the 
grid  shown  has  only  25  sub-regions,  that  actually  used  in  the 
coiqputer  analysis  had  over  3600. 
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While  this  is  less  cooplex  problem  mathematically  than  the 
Clinic's  two-sensor  model,  it  is  clear  from  the  grid  that  many  of 
the  same  comments  apply.  For  example,  the  distribution  of  radar 
readings  certainly  does  not  follow  the  bivariate  normal 
distribution;  as  in  the  two  sensor  case  corresponding  sub- 
regions  have  differing  areas,  and  so  the  density  functicxi  is 
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skewed.  While  we  did  no  further  analysis,  we  expect  that  the 
location  of  confidence  regions  constructed  for  this  model  would 
depend  on  the  level  of  confidence,  Just  as  In  the  two-sensor 
case.  However,  if  the  distance  r  is  large  enough  ooiopared  to  the 
possible  errors  in  the  angle  and  distance  readings,  it  is 
possible  that  the  bivariate  normal  distribution  may  be  a  good 
approximation  to  the  true  density.  More  research  would  be 
required  to  determine  exactly  when  this  mi^t  be  the  case. 

The  other  type  of  error  that  the  Clinic  began  to  investigate 
is  systematic  error.  Ihis  error  occurs  when  the  readings  from 
the  two  sensors  are  perfectly  correlated,  this  situation  happens 
when  the  same  piece  of  equipment  is  used  to  take  both  readings, 
due  to  inherent  equipment  bias.  It  was  not  possible  to  treat 
this  subject  in  the  depth  desired.  This  topic  will  be  pursued 
further  next  year. 

Lastly,  the  Clinic  considered  in  limited  detail  a  related 
problemi  that  of  terrain  features.  The  area  contained  by  a 
confidence  region  may  include  a  lake,  gorge,  or  other  natural 
area  In  whloh  one  would  hardly  expect  to  find  an  emitter.  Yet 
the  confidence  region  assumes  that  every  point  within  it  is  a 
possible  location.  One  would  deal  with  the  prdblem  by  using 
conditional  probability  techniques.  That  is,  there  are  ways  of 
calculating  the  confidence  that  the  emitter  is  in  the  region, 
while  taken  into  account  that  fact  that  it  cannot  be  in  the 
middle  of  a  lake.  The  difficulty  is  that  terrain  features  seldom 
have  mathematically  pleasing  shapes,  and  are  thus  hard  to  work 
with.  One  ,  solution  to  this  problem  Involves  the  use  of  a 
computer  input  device  called  a  digitizer. 

While  a  lightpen  could  also  be  used,  the  Cllhio  had  access 
to  the  digitizer  at  the  Rose  Institute,  a  research  institute  at 
Claremont  McKenna  College.  With  this  device  a  map  of  the  terrain 
could  be  placed  on  the  digitizer  table,  and  a  ’'picture"  of  the 
probability  distribution  "overlayed"  on  it  by  the  oomputer.  An 
analyst  would  then  be  able  to  specify  vary  irregular  regions  by 
drawing  on  the  digitizer  table  with  an  sleotronio  stylus.  Lakes 
and  other  features  could  be  easily  blocked  out. 

The  Clinic  wrote  a  sosll  amount  of  rather  limited  software 
for  this  purpose,  drawing  on  a  private  software  library  produced 
by  the  Rose  institute.  This  software  was  sufficient  for  our 
research,  but  not  for  the  task  outlined  above.  We  believe  that 
this  is  an  idea  worth  pursuing  in  the  future. 


VII.  Conclusion 


In  its  analysis,  the  Clinio  has  relied  on  extremely  sinple 
models,  with  no  more  than  two  sensors,  to  examine  and  critique 
the  oiassloal  sensor /location  problem  first  studied  by  R.G. 
Stansfield.  Yet  even  with  such  models,  the  effect  of  modifying 
Stanafield’s  parallel  error  displacement  assumption  is  striking. 
When  the  methods  used  by  Stansfield  for  oonstnioting  confidence 
ellipses  is  used  with  the  probability  density  derived  by  the 
Clinio,  the  results  are  decidedly  far  too  optimistic.  As  we 
believe  that  our  modifioation  is  the  natural  way  to  relax 
Stansfield 's  assumption,  our  results  could  oonoeivably  be  quite 
inportant  for  practical  intelligence  gathering  systems. 

It  is  difficult,  if  not  impossible,  to  predict  how  our 
modification  would  effect  situations  with  three  or  more  sensors, 
especially  since  different  intelligence  systems  deal  with 
nultiple  sensors  in  different  ways.  However,  it  is  olear  that  it 
would  be  dependent  upon  the  configuration  of  the  sensors i  a 
triangle  of  sensors  centered  on  the  emitter  might  conceivably 
mitigate  the  error,  whereas  three  sensors  all  arrange  on  one 
baseline  might  even  worsen  the  error.  Further,  while  the  Clinio 
has  studied  several  different  sources  of  errors,  little  has  been 
done  to  consider  them  together.  It  may  be  a  decidedly  ghastly 
brew. 


Finally,  the  Clinic  ohose  to  take  only  one  observation  from 
the  sensors  in  their  analysis,  as  it  was  believed  that  individual 
readings  would  not  likely  be  independent.  It  is  possible  that 
with  more  observations  the  differences  between  the  two  sorts  of 
confidence  regions  would  grow  less;  it  is  also  possible  that 
errors  would  nultiply.  At  any  rate,  it  is  olear  that  a  sizable 
amount  of  research  remains. 


TABLE  1 : 


Probability  Strip  Analysis 


The  following  table  contains  the  results  of  a  probability 
strip  analysis  performed  on  the  80  degree  /  110  degree  case.  The 
standard  deviation  of  the  errors  was  assumed  to  one  degree  for 
both  sensors,  and  the  width  between  the  sensors  was  1000  maters. 

The  left  column  shows  the  probability  contained  in  the 
strips  below  the  true  location  of  the  emitter;  the  right  oolurm 
shows  the  probability  in  the  corresponding  column  above.  As  is 
easily  seen,  the  strips  Just  below  the  emitter  contain  more 
probability  than  those  Just  above.  Thus,  the  density  is  skewed. 


Lower  strips 

0.2025 

0.1723 

0.0828 

0.0306 

0.0060 


Upper  Strips 

0.1976 

0.1609 

0.0768 

0.0H35 

0.0160 


Width  of  strips  ■  50  meters 


TABLE  2: 

Areas  and  Conte Ined  Probabilities  for  Stansfleld  Ellipses 


True  Lines  of  Bearing  (in  degrees) 

MAsSO;  MBsllO;  MAsTO;  MB«17Q{  MA«45;  MBs135', 


1 

i 


I 

I 


9511  Confidence 

JFe&i 

20887 

Probability: 

77.173* 

Centers  X  Coord. 

326.35 

Centers  T  Coord. 

1850.83 

75%  Confidence 

Areas 

9665 

Probability s 

H9.618 

Centers  X  Coord. 

326.35 

Centers  Y  Coord. 

1850.83 

50<  Confidence 

TFeas 

303 

Probabilitys 

28.83^ 

Centers  X  Coord. 

326.35 

Centers,  Y  Coord. 

1850.83 

303 

1433 

58.264* 

77.629* 

60.31 

500.00 

165.69 

500.00 

140 

663 

34.142* 

49.774* 

60.31 

500.00 

165.69 

500.00 

70 

331 

18.495* 

29.635* 

60.31 

500.00 

165.69 

500.00 

Notes  All  figures  in  this  table  were  caleulated  unde'^  the 
assiinption  that  the  two  sensors  were  located  1000  oeters  apart » 
and  that  the  standard  deviation  of  the  error  in  the  sensor 
readings  was  one  degree.  Distancjes  are  in  meters  and  areas  are 
in  square  meters. 


I 

I 


I 
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TABLE  3: 

Areas  and  Contained  Probabilities  for  the  Clinic’s  Ellipses 


True  Lines  of  Bearing  (in  degrees) 


MAsSO:  MBsllO: 

MA*70:  MB«170{ 

MA-45;  MB»1355 

951  Confidence 

Area: 

M3257 

989 

2949 

Probability: 

95.0021 

95.0111 

95, m% 

Center:  X  Coord. 

324.36 

60.90 

499.86 

Center:  Y  Coord. 

1875.51 

167.27 

500.52 

751)  Confidence 

'Area: 

19800 

455 

1364 

Probability: 

T5.015 

75.027» 

75.711» 

Center:  X  Coord. 

325.44 

60.58 

499.94 

Center:  Y  Coord. 

1862.16 

166.42 

500.25 

50t  Confidence 

Area: 

9884 

227 

692 

Probability: 

50.096 

50.230» 

50.66711 

Center:  X  Coord. 

325.90 

60.44 

499.98 

Center:  Y  Coord. 

1856.50 

166.06 

500.13 

Note:  All  figures  in  this  table  were  oaloulated  under  the 
assunptlon  that  the  two  sensors  were  located  1000  meters  apart, 
and  that  the  standard  deviation  of  the  error  in  the  sensor 
readings  was  one  degree.  Distances  are  in  laeters  and  areas  are 
in  square  meters. 
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Figure  2 


Stansfield’s  Two-Sensor  Model 
Error  Displacement 


SI  Baseline  S2 


22 


Figure  4 
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The  Clinic's  Two-Sensor  Model 


The  Clinic's  Probability  Grid 
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Figure  15 
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Figure  17 


One-Sensor  Probability  Grid 
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